Cross-Fitted Residual Regression for High-Dimensional Heteroscedasticity Pursuit

نویسندگان

چکیده

There is a vast amount of work on high-dimensional regression. The common starting point for the existing theoretical to assume data generating model homoscedastic linear regression with some sparsity structure. In reality homoscedasticity assumption often violated, and hence understanding heteroscedasticity critical importance. this article we systematically study estimation heteroscedastic model. particular, emphasis how detect estimate effects reliably efficiently. To end, propose cross-fitted residual approach prove resulting estimator selection consistent establish its rates convergence. Our has tuning parameters be determined by in practice. We novel BIC parameter consistency. This first result under heteroscedasticity. analysis more involved order handle heteroscedasticity, develop couple interesting new concentration inequalities that are independent interests.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Methods for regression analysis in high-dimensional data

By evolving science, knowledge and technology, new and precise methods for measuring, collecting and recording information have been innovated, which have resulted in the appearance and development of high-dimensional data. The high-dimensional data set, i.e., a data set in which the number of explanatory variables is much larger than the number of observations, cannot be easily analyzed by ...

متن کامل

Robust High Dimensional Sparse Regression and Matching Pursuit

In this paper we consider high dimensional sparse regression, and develop strategies able to deal with arbitrary – possibly, severe or coordinated – errors in the covariance matrix X . These may come from corrupted data, persistent experimental errors, or malicious respondents in surveys/recommender systems, etc. Such non-stochastic error-invariables problems are notoriously difficult to treat,...

متن کامل

Modified Cross-Validation for Penalized High-Dimensional Linear Regression Models

In this article, for Lasso penalized linear regression models in high-dimensional settings, we propose a modified cross-validation (CV) method for selecting the penalty parameter. The methodology is extended to other penalties, such as Elastic Net. We conduct extensive simulation studies and real data analysis to compare the performance of the modified CV method with other methods. It is shown ...

متن کامل

Reduced Heteroscedasticity Linear Regression for Nyström Approximation

The Nyström method is a well known sampling based low-rank matrix approximation approach. It is usually considered to be originated from the numerical treatment of integral equations and eigendecomposition of matrices. In this paper, we present a novel point of view for the Nyström approximation. We show that theoretically the Nyström method can be regraded as a set of pointwise ordinary least ...

متن کامل

On Heteroscedasticity in Robust Regression

This work studies the phenomenon of heteroscedasticity and its consequences for various methods of linear regression, including the least squares, least weighted squares and regression quantiles. We focus on hypothesis tests for these regression methods. The new approach consists in deriving asymptotic heteroscedasticity tests for robust regression, which are asymptotically equivalent to standa...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Journal of the American Statistical Association

سال: 2021

ISSN: ['0162-1459', '1537-274X', '2326-6228', '1522-5445']

DOI: https://doi.org/10.1080/01621459.2021.1970570